Levenberg–Marquardt method and partial exact penalty parameter selection in bilevel optimization
نویسندگان
چکیده
Abstract We consider the optimistic bilevel optimization problem, known to have a wide range of applications in engineering, that we transform into single-level problem by means lower-level optimal value function reformulation. Subsequently, based on partial calmness concept, build an equation system, which is parameterized corresponding exact penalization parameter. then design and analyze Levenberg–Marquardt method solve this parametric system equations. Considering fact selection parameter critical issue when numerically solving reformulation, conduct careful experimental study effect, context method, while using Bilevel Optimization LIBrary (BOLIB) series test problems. This enables construction some safeguarding mechanisms for practical robust convergence can also serve as base penalty other algorithms. compare introduced paper existing algorithms similar nature.
منابع مشابه
Steering Exact Penalty Methods for Optimization
This paper reviews, extends and analyzes a new class of penalty methods for nonlinear optimization. These methods adjust the penalty parameter dynamically; by controlling the degree of linear feasibility achieved at every iteration, they promote balanced progress toward optimality and feasibility. In contrast with classical approaches, the choice of the penalty parameter ceases to be a heuristi...
متن کاملADMM Penalty Parameter Selection by Residual Balancing
Appropriate selection of the penalty parameter is crucial to obtaining good performance from the Alternating Direction Method of Multipliers (ADMM). While analytic results for optimal selection of this parameter are very limited, there is a heuristic method that appears to be relatively successful in a number of different problems. The contribution of this paper is to demonstrate that their is ...
متن کاملAdaptive ADMM with Spectral Penalty Parameter Selection
The alternating direction method of multipliers (ADMM) is a versatile tool for solving a wide range of constrained optimization problems, with differentiable or non-differentiable objective functions. Unfortunately, its performance is highly sensitive to a penalty parameter, which makes ADMM often unreliable and hard to automate for a non-expert user. We tackle this weakness of ADMM by proposin...
متن کاملOptimization of Parameter Selection for Partial Least Squares Model Development
In multivariate calibration using a spectral dataset, it is difficult to optimize nonsystematic parameters in a quantitative model, i.e., spectral pretreatment, latent factors and variable selection. In this study, we describe a novel and systematic approach that uses a processing trajectory to select three parameters including different spectral pretreatments, variable importance in the projec...
متن کاملA Bilevel Optimization Approach for Parameter Learning in Variational Models
In this work we consider the problem of parameter learning for variational image denoising models. The learning problem is formulated as a bilevel optimization problem, where the lower level problem is given by the variational model and the higher level problem is expressed by means of a loss function that penalizes errors between the solution of the lower level problem and the ground truth dat...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Optimization and Engineering
سال: 2022
ISSN: ['1389-4420', '1573-2924']
DOI: https://doi.org/10.1007/s11081-022-09736-1